DOCUMENT RESUME 



ED 048 442 



VT 012 045 



AUTHOR 

TITLE 

INSTITUTION 

SPONS AGENCY 

PUB DATE 
NOTE 



Athelstan, Gary T.; And Others 

Pilot Study of the Practice of Physical Medicine and 
Rehabilitation. Final Report. 

American Rehabilitation Foundation, Minneapolis, 
Minn. 

Social and Rehabilitation Service (CHEW) , 

Washington, D.C. 

Mar 7 0 
20p. 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



EDRS Price MF-$0.65 HC-$3.29 

Behavior Patterns, ^Clinical Experience, ^Evaluation 
Techniques, ^Interaction Process Analysis, Manpower 
Utilization, Medical Services, Paramedical 
Occupations, Professional Training, ^Rehabilitation, 
^Research Methodology, Taxonomy 
*Physiatrists, Physical Medicine 



ABSTRACT 



This study is intended to provide the methodology 
for a full-scale study which will develop a model of physician 
behavior in the practice of physical medicine, evaluate the adequacy 
of residency training in this field, and analyze the role of 
paramedical personnel in rehabilitation. Regular staff members of the 
Commission on Education in Physical Medicine and Rehabilitation 
recorded the activities of eight physiatrists for 4 months. Although 
acquainted with medical terminology, they were not familiar with the 
practice of physical medicine, and they avoided all unnecessary 
interference, so that their influence would not bias the data. The 
data classification techniques developed from the observations 
demonstrate the feasibility and desirability of a comprehensive 
study. (BH) 
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FINAL REPORT 



Pilot Study of the Practice of Physical Medicine and Rehabilitation 
Gary T. Athelstan, Karen C. Spensley, and Diane C. Tessarl 

INTRODUCTION 

The primary purpose of this pilot study was to prepare for a full-scale, 
comprehensive study of the practice of physical medicine and rehabilitation. 
Since the full-scale project Is of a type which has seldom been done In medi- 
cine, and never in physical' medicine and rehabilitation, the pilot work was 
aimed at developing the methods, instruments, and techniques required for 
later use in the comprehensive study. 

Although some substantive findings regarding the practice of physical 
medicine and rehabilitation are reported here, they are based on very limited 
and not necessarily representative samples of physiatr ists’ work. Therefore, 
any statements In this report which describe physiatric practice, or which 
suggest conclusions about its nature must be regarded as preliminary and 
tentative. This study can be realistically evaluated only in terms of the 
contribution it has made to the merhodo log leal possibility of studying the 
practice of physical medicine and rehabilitation. 

The objectives of the full-scale project would be: 

1) To develop a detailed descriptive model of physician behaviors 
in the practice of physical medicine and rehabilitation. 

2) To evaluate the adequacy of residency training in this field, 
in terms of its relevance to the demands of actual practice. 

3) To obtain detailed data on patterns of utilization of paramedical 
personnel in rehabilitation, to determine which functions in 
rehabilitation require the unique training and skills of the 
physiatr 1st, and which may be delegated to other workers. 

Examples of the discontinuities between training and practice with which 
the Commission is concerned may be cited as follows: (I) Previous Commission 

studies have revealed that over 50# of a 1 1 certified physiatr ists hold academic 
appointments and do some teaching in medical schools. Practically none have 
had any formal experience or preparation for teaching activities. (2) In the 
area of clinical practice, it is believed that leadership of the rehabilitation 
team is one of the critical functions that physiatr ists serve. We are not 
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aware of any training programs that Include group dynamics, team leadership, 
or any other topic appropriate to this function. 

The Commission has also been long concerned with the critical shortage 
of qualified practitioners in the field of physical medicine and rehabilita- 
tion. This shortage, and the need for additional practitioners, has been 
well documented in previous Commission publications. A study of the ways in 
which physiatrists utilize their time would suggest means of making their 
practice more efficient. Previous studies suggest that physicians spend a 
great deal of time on functions that do not require their specialized training 
and skills. The planned full-scale study would identify such functions in 
rehabilitation, and analyses of the data and study of "natural experiments” 
already in progress would indicate ways of accomplishing + hese functions, 
alternative to requiring the direct intervention of the physiatrist. 

In addition to examining procedural aspects of clinical practice, the 
full-scale stuc would also evaluate more general patterns of time utiliza- 
tion among physiatrists whose primary responsibilities are in teaching and 
administration. The Commission has found, for example, that academic physia- 
trists spend a reported average of only about 14/5 of their time teaching 
medical students. This figure, if found to be true in observations of 
academic physiatrists at work, suggests that much could be done to relieve 
the shortage of academicians in this field by finding ways of reducing the 
unessential, non-academic functions of those with primary teaching respon- 
sibi I ities. 

The basic data needed to answer even relatively general questions 
about the practice of rehabilitation medicine are not available. More 
Important for the purpose of this study, the methods for obtaining such 
data are in a very crude state of development. Professional or executive- 
level jobs have seldom been studied with objective techniques, and the 
limitations of such techniques quickly became evident to the Commission 
staff. 

Among the more challenging methodological problems faced by the staff 
was that of obtaining useful data about needs for training. Direct observa- 
tion, which appeared to be a very promising method for meeting the other 
study objectives, would not, by itself, reveal gaps in the training of phy- 
siatrists. It seems possible that the most critical training requirements 
are for rare behaviors, those which might not appear in even a very lengthy 
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series of observations, or for "judgmental" or other unobservable behaviors 
which would not be recorded by observation alone. However, the full-scale 
study would utilize not only direct observation, but also such techniques 
as self-report and work inventories. In addition, the data would be sub- 
jected to systematic evaluation by educators and practitioners of physical 
medicine and rehabilitation in order to make decisions about training re- 
quirements and possibilities for delegation of tasks. 

METHOD 

Since one of the principal aims of this pilot work was to develop record- 
ing forms to be used in gathering data on what physiatrists do, the necessary 
first step was to develop an outline of appropriate activity dimensions. This 
we did by direct observation. The instruments developed (exhibit I) to record 
physiatrist behavior evolved from simple note- taking to systematic collection 
of data in categories developed by the observers. To avoid the bias of ini- 
tially incorporating predetermined ideas about the practice of physiatry, 
no attempts were made before beginning the observations to identify even broad 
areas of physicians' responsibility. Additional measures were taken to avoid 
biasing the objective behavioral records. These included: I) Using medically 
naive observers who would make few assumptions about what they were observing. 
2) The observers viewed the se-so behaviors much of the time, but made their 
records and initially developed their categories independently of one another 
to provide checks on objectivity and inter-observer agreement or reliability. 

Observers 

The technique used in recording physiatrist activities was simply that 
of following the physician, observing and recording his activities during 
relatively large, continuous blocks of time. The observers (the junior 
authors of this report) were regular staff of the Commission on Education 
in Physical Medicine and Rehabilitation. As such, they were familiar with 
the principles, vocabulary, and some of the procedures of rehabilitation 
medicine, although they had had very little contact with physical medicine 
and rehabilitation in practice. They appeared to be about the age of 

medical students and were apparently so identified by many patients. They 
wore white lab coats and deliberately remained as unobtrusive as possible. 

d 
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In a full-scale study, medical students on "free-term" fellowship programs 
could serve as very suitable observers, although the use of trained research 
personnel as observers would probably be preferable if it could be arranged. 

In the first place, satisfactory performance in the observer role appeared to 
depend more upon research skills than upon medical knowledge, thus eliminating 
any advantage that medical students or physicians might be presumed to have. 
Secondly, the use of non-modical observers avoids the possibility that a 
student- teacher relationship might develop between the observer and his sub- 
ject, or that a subject physiatrist might feel that his performance is being 
"evaluated," instead of merely observed and recorded. 

Before beginning actual observations, the observers attempted to famil- 
iarize themselves with sraff names and positions and patient names and diagnoses, 
in order to be able to identify the occupations of staff, persons mentioned in 
conversation, or people speaking with physiatrists by telephone. It also 
appeared to be important to Introduce the observers and their purpose to 
hospital staff, to avoid questions and introductions during observation periods. 
Before observing began, the observers also studied the forms and patient charts 
used, in order to be able to Identify, from a distance if necessary, what sort 
of paperwork the physiatrist might engage in from time to time. 

Our efforts to insure objectivity and to avoid interfering in any way 
with what was being observed appeared to be very successful. The patients and 
most clinical personnel seldom responded in any way to the presence of the 
observers. The subject physiatrists expressed some feelings of self-conscious- 
ness at first, but quickly became accustomed to their "shadows" and were not 
affected by the process. Observer questions and requests for interpretation 
were kept to an absolute minimum and were withheld until the end of an 
observation period. However, all of the subject physiatrists were very 
interested in the study and eager to cooperate, and sev< r ' r al would occasionally 
vojunteer explanations of procedures which they felt might be confusing to 
the observers. 







5. 



Subjects 

The subject physiatrfsts were chosen for the pilot study to represent 
the widest possible range of different settings and patterns of activities 
that could be observed within a reasonable distance of the Commission offices. 
Selecting the subjects in that way enabled us to develop a system and recording 
form that would encompass nearly all of the different physiatrist activities 
that might be observed in a full-scale study. Working together, the observers 
spent a total of 224 hours over about four months following eight different 
physiatrists. These physicians practice in a rehabilitation center, a 
university hospital, and a veterans administration hospital. Among them, two 
were primarily administrators, two were in children’s rehab t I itation, and one 
was in clinical research. Most of them were accompanied by residents and/or 
medical students part of the time they were observed. Exhibit 2 displays the 
observation time by setting. Of the total hours of observation time, 24 hours 
were spent testing and improving what is essentially the present coding system. 

Record i nq System 

The data were gathered and recorded, eventually in codes suitable for 
adaption to electronic data processing, but at first, according to the 
following scheme: I) the time a procedure or interaction begins; 2) basic 

category of activity observed, i.e., whether patient care, education, research, 
administration, or other; 3) action of the physiatrist, e.g., speaking, 
writing, observing; 4) subject of the activity, e.g., manual muscle testing, 
ADL's; 5) object of the activity, other persons or objects involved, e.g., 
patient, occupational therapists, equipment, paperwork. 

The first day of observation in each setting typically included several 
instances in which the presence of a stranger affected the physiatrist’s 
activities. He asked questions about \he studies, offered suggestions, 
introduced the observer to people, or stopped to explain an activity or 
situation. The observers avoided initiating interactions with the physician, 
but did not try to discourage his interest, suggestions and explanations. 
Physiatrist’s comments and explanations were extremely helpful to the project. 
Usually by the second day of being observed the physiatrist appeared to have 
little awareness of the observer. 
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Exhibit 3 gives an example of physlairist activities as observed and 
recorded using the system developed. It is a sample of the notes taken early 
In the project, with codes added later. Both observers’ codes are listed 
to Illustrate the kinds of discrepancies that occurred between observers. 

While we assessed I nter-observer agreement, we did not attempt a 
statistical determination of I nter-observer reliability for several reasons. 
Most importantly, the pace of the physlatri st’s activities and the complexity 
of the recording system makes one-to-one matching of observers’ codes meaning- 
less, The level of agreement In such matching Is almost entirely dependent 
upon the specificity of the records. Complete agreement between raters in all 
categories of behavior would suggest that the behavioral units being recorded 
were too gross to yield useful Information. On the other hand, there were 
very obvious limits to the amount of detail that could be recorded. Re- 
cording systems with categories much "finer” than those we developed would 
be too complex to work with, even for well trained observers* A better 
assessment of reliability would be to summarize hours of data recorded by 
trained observers and compare their results. 

A number of recording systems and devices were investigated. This 
process consumed a great deal of staff time, but It was considered necessary 
to solve the sizable mechanical problems involved in recording &nd trans- 
forming for analysis the enormous quantities of data gathered In such obser- 
vational studies. The systems considered included a variety of streamlined 
recording forms, such as IEM Mark- Sense forms, etc., that are sometimes used 

In work measurement studies. 

For a full-scale study of the practice of physical medicine and rehabili- 
tation, our Investigation suggested that the best results In gathering obser- 
vational data could be obtained with a magnetic tape push-button coding system 
rather than with / paper and pencil system. A tape system has been developed 

for social Interaction research at the University of Minnesota, and It was 
carefully Investigated for Its applicability to this study. The system (Min- 
nesota interaction Data Coding and Reduction System) Is explained In some de- 
tail In exhibit 5. The advantages of this tape system are that observation 
time is recorded accurately and automatically, and that several middle steps 
in the process of putting data on cards or tape for analysis are eliminated. 
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In addition, the ease and speed with which events can be recorded make 
possible a considerable increase in the number of behavioral categories 
which can be used while still preserving an acceptable level of accuracy. 

Although many of the pilot data were gathered by direct observation, 
it is likely that the principal data-gather i ng technique used in the full- 
scale study would be some form of self-report work inventory In which the 
physiatrists would record their own activities. The self-report task I nven^ 
tory approach has been used successfully in several studies of other rehabi- 
litation professionals, most notably in research recently conducted by 
Dr. John Muthard at the University of Florida at Galnesviile. The actual 
production of such an inventory for studying the work of physiatrists was 
beyond the scope of this pilot project, but the coding categories developed 
and the data gathered here provide nearly all of the activity categories and 
behavior descriptors that would be needed for a task inventory. The first 
step in the full-scale study would be +o put such an inventory into written 
form and pre-test it with small samples of physiatrists, an effort that 
could now be accomplished very readily. 




Development of the Recording Form 

In the process of developing the recording form, the observers followed 
the rehabilitation center physiatrist for several days, taking copious notes. 
From these notes, the following variables could be identified: 

1) Broad category of activity, e.g., direct and indirect patient care, 
education, administration, research, and other. 

2) Name of event, e.g., ward rounds, progress (paper) rounds, gym 
rounds. 

3) The observable behavior of the physiatrist, e.g., speaking, 
listening, reading. 

4) The subject of the behavior, e.g., undergraduate medical education, 
patient's ability to follow instructions, physical therapy treatment 
program. 

5) Patient involved (if any), disease category. 

6) Other individuals, groups, or objects involved, e.g., nurse, team, 
equipment. 

7) Time each activity ' ~ behavior begins (in order to determine time 
spent) . 
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Between observation periods observers at J mpted to sort behaviors observed 
into categories. As expected, the number of categories grew as observation 
time Increased. The range of categories in the system and the areas of 
emphasis also changed as different physiatrists 1 patterns of practice were 
added to the observers 1 experience. The rehabilitation center physiatrist, 
in addition to the usual patient care activities, supervised a resident, 
directed a major research project, was involved in preparation of educational 
materials and in courses at the center and at the university, and is a leader 
in community action programs related to healtn and rehabilitation. The set 
of categories first developed after observing this physiatrist had more research 
and community activity categories, and fewer different patient care and 
administration behaviors than were needed to account for the activities of the 
other physiatrists. 

At the Veterans Administration Hospital the rehabilitation ward was full, 
and the physiatrist immediately responsible for the ward practiced without a 
resident. Consequently he spent more time in the care and treatment of patients. 
The third physiatrist observed directed the VA Hospital Physical Medicine and 
Rehabilitation Department and thus administered the therapy departments in 
addition to the patient care responsibilities he carried. He also had a part- 
time university teaching position. 

By the time the observers began to record the activities of the university 
physiatrists, few categories were added or combined, but some adjustments were 
made in the coding system. For example, we resolved some of the complications 
that result from the combination of activities, such as when education end 
patient care or research and patient care take place simultaneously. At the 
university, the physiatrists observed were involved In education of residents, 
medical studants, and paramedical personnel. Their responsibilities included 
didactic and clinical teaching, and such combinations of activities as 
educational administration, and research in education. One university physia- 
trist spent most of his time in clinical research. The department head Is an 
administrator, educator, and writer, and is active in the professional organi- 
zations. 

Initial attempts to construct a form were based on +he names of the acti- 
vities’* such as progress rounds (team conferences ), ward rounds, and gym rounds. 
This resulted in a set of five forms - four for paticn + care and one for other 
activities. These were extremely cumbersome, but did serve to tost an Initial 
set of categories. 

o 
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At the same time that we were attempting to develop categories and 
coding forms by a series of "successive approximations," we also established 
more systematic ways of taking notes. These notes began to include codes 
that grew out of the activity categorization attempts. The final "form" repre- 
sents essentially a refinement of the note taking system. 

RESULTS 

The final coding system included all but two of the seven variables 
identified initially. "Name of activity" and "patient characteristics" are 
not specifically included. Team conferences can be identified by the 
phys iatr i st's interaction with the team (TM). Patient characteristics can 
be listed in the observer’s notes, and can be determined outside the observa- 
tion period. 

Some of the difficulties in categorizing behavior which we identified 
immediately were with I) the fast pace of activities, 2) dual purpose activities, 
and 3) determining the purpose of the action. 

The swift pace of a physiatr ist's activities made recording difficult. 

The mean duration of physiatrists’ activities at the level of specificity 
we were able to record was about four minutes. The modal length of recorded 
events was less than one minute. Even these brief activities usually con- 
tained several separate categories of behavior. Observers sometimes recorded 
eight or ten events per minute in a classification scheme designed to record 
behavior in categories fine enough to be useful in assessing residency training 
or patterns of utilization of paramedical personnel. 

Frequently one activity serves two or more major functions. For example, 
when a resident participates in patient care, the physiatr ist's activities 
fall into both the patient care (P) and education (E) categories. Under the 
present coding system, if the resident and patient are present the activity is 
coded "P" and "E". 

Although always coded "E", there were many times when the resident's 
involvement in the physiatrlst's activities did not appear to be for the 
purpose of education. The resident frequently acts as the physiatrist's 
assistant, doing the history and physical, and other general physician tasks. 
Physiatric residents are often certified in another specialty, and the residents 
we observed functioned much of the time as colleague and/or consultant. On 
the other hand, the physiatrist may explain a patient's treatment to a student. 
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an activity which might be performed solely for the purpose of education, 
and a patient’s presence or patient care may be Incidental. 

A primary goal in the development of categories was to maintain an 
objective record of overt behavior. However, we did attempt to make 
judgements when an "educated guess" would add to, not detract from, or 
bias, data collected. We attempted to discriminate, for example, between 
situations in which the physiatrist was actually teaching, and those in 
which he observed or was assisted by a resident or medical student. Ex- 
hibit 3 shows examples marked with an asterisk (activity code 5 = teaching, 

4 = discussing), of such dual-purpose behaviors for which coding conventions 
could be readily developed. For the full-scale study, of course, an explicit 
decision rule would be established to handle this and similar ambiguous coding 
situations. 

Another situation in which the observers need to exercise some judge- 
ment is that of determining the purpose of parts of the patient evaluation 
examination. It is more meaningful for most of our study purposes to de- 
scribe an activity as "manual muscle testing" or "test of flexion, exten- 
sion" than to say "the physician moves the patient’s arm". 

A major complication in categorizing observ* J behavior that was not 
discovered Immediately was that the two observers watching the same phy- 
siatrist were often not recording the same activities. In the continuous 
flow of conversation and activity there are seldom easily identified 
beginning and ending points. In fact, even the definition of an "event" 
is essentially arbitrary. A discussion with a nurse can touch on the con- 
dition, abilities and treatment of several patients in a minute or two. 

In such situations each observer might record up to eight or ten"items" a 
minute and find that only half of those matched items noted by the other 
observer. The two observers identified the same actions about 80# of the 
time, and agreed perfectly on codes for more than half of those items. 

Disagreements noted in exhibit 3 illustrate some of those found in 
actual observation records, but did not occur in the same proportions. 

In the observation period, more than 2/3 of the disagreements were confined 
to the "subject of the activity" codes (10-99). Many of the inter-observer 
disagreements in both the coded notes and actual observation record could 
be eliminated by establishing a convention for certain easily identified 
behaviors (marked "CONV" on exhibit 3) or by making use of the summary cate- 
O gories 10, 20, 30, 40 (marked "SUM" on exhibit 3). 

:R1C 
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The disagreements of more substance are among the full sets of evalua- 
tion and treatment categories (marked "E-E" or "E-T" on exhibit 3). A 
brief conversation could include discussion of muscle weakness (P23) re- 
sponsible for disability to perform a task (P33), so that patient should 
get OT exercise or activity (P43). Each observer may record a different 
one of these codes to represent the most prominent point of the discussion. 

The most common disagreement in observation was between 34 and 44, mental/ 
emotional ability and treatment. As is evident in' the assignment of cor- 
responding numerical codes, we recognized some natural configurations of 
condition, abilities and treatment. While two observers may disagree 
whether an exchange was essentially around evaluation or treatment, their 
codes will identify whether it was related to speech, emotion, or to the 
broad interwoven set of categories concerned with muscu lo-skeleta I physical 
conditions, abilities, and treatment. 

As mentioned previously, statistical reliability of categorization 
of observed behavior, i.e., matching codes to determine what percent of 
the time observers agree. Is largely a function of the "fineness" of the 
categories. A fairly high reliability figure could be cited for observa- 
tions using only the "basic purpose", "physiatrist activity", and "other 
person" categories. The fineness of the categories could, of course, be 
adjusted to serve various data collection purposes. While the "subject of 
the activity" categories, for example, are more difficult to discriminate, 
and therefore less reliable, they are among the few that are relevant to 
an educational evaluation purpose, and they should presumably be retained. 

SUMMARY AND SUGGESTIONS FOR FURTHER RESEARCH 
The results of the pilot study clearly demonstrate both the feasibility 
and the desirability of a full-scale study of the practice of physical medicine 
and rehabilitation. The findings are summarized below as they relate to each of 
the objectives of the full-scale project, respectively: 

I) To develop a detailed descriptive model of physician behaviors in 
the practice of physical medicine and rehabilitation. 

The observation recording system designed in this Pilot Study could be 
used in the full-scale study to produce a descriptive model of physiatrist 
activities. Such a model would provide information such as the number of hours 
or percent of time spent giving general physical examinations, measuring range 
lotion, administering EMG's, or performing other specific activities. 
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This type of record could, among other things, permit the identification of 
"routine," i.e., repetitious or frequently-performed behaviors, which would 
be a reasonable first step in the objective isolation of potentially dele- 
gatable activities. 

Exhibit 4 displays a breakdown of physiatrtst activities in much more 
general terms. Broad categories of activities like these could be extracted 
from behavioral records produced with this system, oy selecting certain 
codes. For example, time spent in activity 4 (patient care paper work of 
exhibit 4) could be compiled by adding all the time spent in basic activity 
category "P!' (patient care) with the object PW (paper work) or FI (patient 
charts and f i les) . 

In the course of the pilot work, several systems for recording and ana- 
lyzing observational data were investigated. The most promising of these, 
and the one strongly recommended as an adjunct to the task inventory for a 
full-scale study, was the Minnesota Interaction Oata Coding and Reduction 
System. This system is described in detail In Exhibit 5. 

The data to be gathered in the full-scale study would be obtained by a 
combination of methods, most importantly by some form of self-report task in- 
ventory. The basis for developing a physiatr ists* task inventory is provided 
by the findings of this pilot work. Actually producing such an inventory 
would be one of the first steps of the full-scale study. 

2) To evaluate the adequacy of residency training in this field, in 
terms of its relevance to tho demands of actual practice. 

This objective may prove to be the most difficult to achieve of those 
originally stated for the full-scale study. As was previously mentioned, re- 
lating the observed behaviors of practicing physiatrists to the content of 
their training programs does not directly reveal discontinuities between train- 
ing and the demands of practice. Such gaps can only be identified by supple- 
menting a trai ning-to-practice matching analysis with a very thorough evalua- 
tion of all the data by experts in the field. However, the Commission expects 
to be able to resolve most of the difficulties in this phase of the full-scale 
study through appropriate and extensive use of the substantial resources for 
research that it has developed. The Commission possesses considerable detailed 
data on the content of residency training, which have been gathered In its studies 
of these programs. In addition, the Commission members and their consu Itants .are 
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leading authorities in education and practice in rehabilitation medicine, and 
thei ' judgments, systematically gathered and analyzed will provide an impor- 
tant means of evaluating training in this field. 

3) To obtain detailed data on patterns of utilization of paramedical 
personnel in rehabilitation, to determine which functions in re- 
habilitation require the unique training and skills of the physia- 
trist, and which may be delegated to other workers. 

As with the second objective above, this goal must also be partly achieved 
through the use of expert judgment. Although this process is partly subjective, 
it is possible, as previously implied, to largely objectify the judgments and 
make them reliable. Objectivity is achieved by using a "concensus of expert 
judgment" procedure in which individual opinions or options are assigned 
numerical values, and the pooled judgments of experts are statistically ana- 
lyzed to make an arithmetic decision. This method could be ve’-y useful in 
making judgments about delegating responsibility to lesser trained workers, 
and it would also constitute the princioal technique for the evaluation of the 
training programs. 

The findings of the pilot study naturally did not confirm all the expecta- 
tions of the Commission. For example, the methodological problems inherent in 
a study of this sort seemed sufficiently challenging in the abstract. In reali- 
ty, these problems seemed at times to be impossibly complex. However, the Com- 
mission is now, more than ever, convinced of the need for such a study, and con- 
fident that it wi 1 1 help to solve some of the pressing problems in rehabilita- 
tion medicine. Some of the substantive findings of the study suggest new and 
additional issues which will be dealt with In tho full-scale s^udy. 

Although not enough physiatrist time was recorded in this study for 
statements describing physiatrists* practices to be considered reliable or 
significant, it is interesting to note the differences, as shown In exhibit 4. 
The clinical physiatrist spent more than twice as much time with patients 
as the physician responsible for department administration. T hc physicians 
with residents and medical students spent 49$ of tholr time accompanied by a 
student, 12$ of tholr time teaching. However, they spent 16$ less time fn 
paper work and miscellaneous detail than the VA clinical physician who prac- 
ticed without a resident. While these differences are probaMy not statisti- 
cally significant they confi rm the impressions of the observers that the 
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resident acts as a physiatrist assistant, relieving him of many clerical 
duties. The observers noted that the physiatrist practicing without a resident 
perfc-med many general physician duties while those with residents delegated 
the routine history and physical, and seemed to do little that would not be 
considered part of the specialty of physical medicine and rehabilitation. 

Since the pilot work was begun, the Commission has developed a 
considerable interest in the possibility of training and using physician 
assistants in the field of physical madicine and rehabilitation. Although 
more data are obviously needed to evaluate the substantive findings 
of this pilot study, the observers did record some distinct impressions 
relevant to the use of physician assistants in this field: I) Physiatrists 

already make very heavy use of paramedical personnel, especially in clini- 
cal care; some physiatrists seem to make such good use of clinical assis- 
tants that they intervene in patient care only when the exclusive skills 
of a physician are required. Their clinical capabilities could scarcely 
be further augmented by clinical assistants. 2 ) Some physiatrists seem to 
spend a significant amount of time in non-clinlcal activities, primarily 
of a medical administration nature. Their clinical capabilities could 
probably be considerably augmented through the use of a "rehabilitation 
coordinator" - type of assistant. In addition, of course, most physia- 
trists could presumably extend their effectiveness by using assistants who 
were properly trained to substitute for them in certain defined areas of 
medical and non-medical responsibility. 

At any rate, there is little doubt that a comprehensive study of the 
practice of physical medicine and rehabilitation would provide information 
of great value in answering a number of crucial questions confronting the 
field today. The present study, of course, does not begin to directly answer 
any of those questions, but by demonstrating the feasibility of a full-scale 
study, and by resolving some of the major methodological problems that 
would be encountered in such a study, this pilot project can contribute 
significantly to progress in the practice of physical medicine and rehabi- 
litation. The staff and the members of the Commission on Education in 
Physical Medicine and Rehabilitation recommend strongly that a full-scale 
study be undertaken. 
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I. 



EXHIBIT 


1 : Cod i ng Categor 1 es 


BASIC PURPOSE CATEGORIES 


PHYSIATRIST ACTIVITY CATEGORIES 


Up to 2 may be used. Put pri- 
mary code In column 2. Column 
1 may be blank. 


Only one may be used. Column 3. 

1 = examines, administers diagnostic test (20' 
or treatment (40's). Usually non-verbal, 
except to ask patient to demonstrate 


P = patient care, management 
(i.e., care of a specific 
patient) 

E = education 
R = research 
A ■ administration 
0 = other, unidentified 


abi 1 ities ( 30 ' s ) 

2.= orders or suggests treatment procedures, 
prescribes (may be verbal or written) 

3 = makes arrangements, schedules something 
(may be verbal or written) 


For example, "resident watches 
physiatrist test patient's 
ability to follow Instruc- 
tions" would be coded: 


4 = verbal exchange, discussion, Inquiry, 

participates In meeting, team conference 

5 = teaches, demonstrates, explains to 

student, lectures 


col . 123 4-5 6-7 8-9 

E P 1 34 PA RE 


6 = writes other than orders and arrangements, 
letters, reports, progress notes 
(Includes dictation for charts) 


Basic code for Incident Is In 
col . 2. 


; = reads, scans x-rays, looks at chart 
8 = observes, attends, listens to report, 


Additional code for resident 
education Is In col . 1 . 


watches someone else work with patient 
or test patient's abilities (I.e., takes 
more passive role) 

9 = other, unidentified 


For another example, "physia- 
trist watches resident test 
patient's gait" would be coded: 


0 = non-business or nothing accomplished 
time, personal, travel, looking for 
patient or staff member, waiting 


col. 123 4-5 6-7 8-9 

P E 8 32 RE PA 





(Continued on next page) 
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EXHIBIT I: Coding Categories (Continued 



\ 

OTHER PERSONS, OBJECTS INVOLVED 



Up to 2 may be used, in order of primacy. 
Columns 6-7, 8-9. 

PA = patient 

PF = patient and family together 

FM = family of patient 

MD = another physician 

NU = nurse, RN, LPN 

NA = nurse's aide 

OY = orderly 

PT = physical therapist, PT aide 
OT = occupational therapist, ass't 
CT = corrective therapist 
ET = educational therapist 
TX = other therapist 
SP = speech pathologist, audiologist 
PS « psychologist 
SW = social worker 

LM = limb-maker, prosthetist, orthotist 

HA = hospital administrator 

ED = educator 

SY = secretary, clerk 

RE = resident 

MS = medical student 

OS = other student 

TM = team, more than two team members 
CS = class 
MG = other group 
EQ = equipment 

FI = patient charts, files, forms 
PW = other paperwork 
99 = other 
00 = unidentified 
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EXHIBIT 2: Observation Time By Setting 



Sett 1 nq 


Number of physicians 
observed 


Tota 1 hours of 
observation 


Rehabilitation Center 


1 


60 1/2 hours 


Veterans Administration 
Hosp 1 ta 1 


2 


105 3/4 hours 


University Adult 
Rehabilitation Center 


3 


35 3/4 hours 


University Childrens’ 
Rehabilitation Center 


2 


21 3/4 hours 



223 3/4 hours 
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EXHIBIT 3: Sample "Raw" Observational Record* 



UNIVERSITY, MD 3 



Time 


Interaction With 
What or Whom 


Object of Interaction 


Observer 

1 


Observer 

2 


D1 screp- 
ancy 2 


9:20 


Secy 




Mlsc. - gives her questionnaire 


03OOSY 


A33CSY 






Med student 
Internship 


on 


Discusses w/hlm what they'll be 
doing for week (he’s on 1 wk. 
surgical subspeclalty rotation). 
Explains booklet, shows him PM&R 
textbook, recommends It, discusses 
his schedule w/him. 


E452MS 


E352MS 

E552MS 


CONV* 


9:25 


Med student 
1 nterrishlp 


on 


Discusses his schedule w/him 










Secy 




Asks her to check on something 
In connection with students schedule 


E352SY 


E352SY 










Back to student 


E452MS 


L452MS 




9:30 


Med Student 




Asks him what he's going Into - 
discusses It with him 
Asks if he’s seen any chronically 
ill PA's lately 


E4I6MS 


E552MS 


CONV* 


9:35 


Med student 




Asks what services he's been on and 
continues along lines of what chroni- 
cally III PA's were seen 


E452MS 








Med student 




Dr. makes notes on blackboard as 
student describes a pa. he had seen 


E4 1 OMS 






9:40 


Med student 




Questions student on how he took 
history on above PA - takes notes on 
b 1 ackboard 


E4I2MS 


E5I2MS 


CONV* 



* Some of the codes used here may not precisely match the final coding scheme since some 
changes were made In the coding categories after this protocol was obtained. 

^Classification of coding discrepancies Is as follows: 

CONV = a coding convention should be established 

SUM = Items could be summarized, or differences due to one observer summarizing 
E-E ■ difference Is between the two evaluation category sets 
E-T = difference Is between evaluation and treatment categories 

* These are examples of cases In which a discrimination was attempted between what Is actually 
teaching (activity code 5) and what Is just discussion (activity code 4) occurring as the 
student or resident assists or accompanies the physfatrlst. 




(Continued on next pane) 
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EXHIBIT 3: Sample "Raw" Observational Record (Continued) 



UNIVERSITY, MD 3 



Time 


Interaction With 
What or Whom 


Object of Interaction 


Observer 

I 


Observer 

2 


Discrep- 

ancy 


9:45 


Med student 


PA is set up now as example - 
continue discussing him - outcome 


E4I0MS 


E5I0MS 


CONV* 


9:50 


Med student 


Continues discussion on above PA 
from chronic illness viewpoint 


E4I6MS 


E 5 1 6MS 


CONV* 






Tells him about history-taking w/PA 
w/chronlc disease. There Is a 
d i f ference 


E4I2MS 


E5 1 2MS 


CONV* 






VA HOSPITAL, MD- 








Time 


Interaction With 
What or Whom 


Object of Interaction 


Observer 

1 


Observer 

2 


Disc ren- 
ancy 


10:25 


RN 


Social Conversation 


0999NU 


P499NU 


CONV 




PA 


Examines leg, verbally notes 
condition, asks about exercises 


PI20PA 

P442PA 


P 1 28PA 
P442PA 


SUM 




PT aide 


Ask him about above PA's arterial 
circulation 


P438PT 


P43GPT 








Also about treatment for PA 


P442PT 


P442PT 




10:30 


Prescription 
on consult 
sheet 


Writes prescription for PA 
(revises treatment) 

Hubbard tank exercises 


P242FI 


P242FI 






PT aide 


Gives him prescription and 
1 nstructions 


P242PT 


P242PT 






PA 


Examines stump (left E3K) 


P 1 20PA 


PI28PA 


SUM 




PT 


Soc 1 a 1 


0999PT 


P499PT 


CONV 




RN 


Soc 1 a 1 


0999NU 


P499NU 


CONV 




Secy 2 


Gives her consult 


P3I0FISY 


P3I0FISY 




10:35 Telephone to 
another MD 


About his exam of PA 
the other Dr. has now - 


P4 1 0MD 


P420MD 


SUM 



to check agreement 

* These are examples of cases In which a discrimination was attempted between what Is actually 
teaching (activity code 5) and what Is just discussion (activity code 4) occurring as the 
student or resident assists or accompanies the physlatrlst. 




(Continued on next page) 
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EXHIBIT 3: Sample "Raw" Observational Record (Continued) 



VA HOSPITAL, MD 2 



Time 


Interaction With 
What or Whom 


Object of Interaction 


Observer 

1 


Observer 

2 


OlscreD' 

ancv 




Secy 1 


Asks her name of 0T student 


E455SY 


E455SY 




10:40 

10:43 


8tl 1 1 on phone 
(M.D. ) 


Also talks about OT student 
and about other MD's having 
been on TV and changes 1 n 
curriculum for MD’s 


E455MD 

E400MD 

E452MD 


E455MD 

E455MD 

E452MD 




10:45 


Consult sheets 


Reads over one 


P7I0FI 


P7 1 OF 1 






Phone to CT 


Asks If PA Is there 


P099CT 


P099CT 






Consult 


Looks at another 


P7I0FI 


P7 1 OF 1 






Oscf f lometrlc 
test report 


Looks over - evaluates 
circulation - writes It on report 


P725FI 


P725FI 




10:48 




(Tells us about PA - ulcer on 
BK stump) 












Writes report on above PA 
°uts In OUT box 


P6I0FI 


P6I0FI 






Mai 1 


Looks It over 


0759MA 


A700MA 






Secy 1 


About request for evaluation 
of PA 


P240SY 


P4I0SY 








Finds PA's room # on directory 


P3I9SY 


P399PW 


C0NV 




Secy 


Asks what room a PA's In 


P3I9SY 


P399SY 


C0NV 




PA (Stroke) 


Examines rt. arm for contractures 
In fingers, hip, knees - finds 
contractures, ulcer, spasticity 


P 1 22PA 
PI26PA 
PI24PA 


P 1 20PA 


SUM 


1 1 :00 


Consult Sheet 


Writes report on PA 


P6I0FI 


P6I0FI 




1 1 :05 


PA directory 


Looks for PA 


P3I999 


P399PW 


C0NV 




RN 


Tells him where he 1 s 


P3I9NU 


P399NU 


C0NV 


11:09 


PA 


Talks to him about operation 


P449PA 


P4 1 2PA 








Examines leg - tests for 
function 


PI32PA 


PI28PA 

PI32PA 






Consult sheet 


Writes report 


P632F 1 


P6I0FI 




0 

ERIC 




Continues exam of function of feet 
(Continued on next page) 


PI23PA 


PI32PA 


E-E 

93 
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EXHIBIT 3: Sample "Raw" Observational Record (Continued) 

VA HOSPITAL, MD 2 



Time 


Interaction With 
What or Whom 


Object of Interaction 


Observer 

1 


Observer 

2 


Di scren 
ancy 






Weak ant. tibs. 














Writes mere 




P623FI 


P623F 1 




11:15 


Stop to watch 


I nauguration 




099899 


0898MG 


CONV 


11:28 


Teacher 


Socla 1 




0998ET 






11:39 


Consult sheet 


Puts In OUT basket 




P3I099 


P3I0FI 






Consult sheet 


Writes report on foot drop 


prob. 


PC3 1 F 1 


P620FI 


E-E 


11:35 




Continues to write report 














Writes Rx for PA 




P200F 1 


P240FI 






Consult sheet 


On PA with foot drop. Reads sheet. 
Writes note to have Dr. see him after 
he sees this PA 


P6I0FI 

P340PW 


P2I0FI 




11:38 


Request for 
material for 
recreat Ion 
therapy section 


Reads over, order, concurs, 
countersigns 




A650PW 


A350PW 




1 1 :40 


Secy 2 


Leaves paper on her desk 




A350PWSY 


A399PW 






OscII. test 
report 


He checks it, OK ? s it (secy 
typed it) 


had 


P725FI 


P725FI 
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EXHIBIT 5: 



The Minnesota Interaction Data Coding and Reduction System (MIDCARS) 
(Adapted from "...An Appraisal..." by Richard E. Sykes) 

Observational research, whether in the laboratory or in the field, 
has always been laborious because of the Immensity of data coding and 
reduction problems. During the summer of 1967 Richard E. Sykes and 
F'raine E. Wh’tney surveyed the available Instrumentation, investigating 
■particularly event recorders, the interaction chronograph, and any other 
equipment which came to their attention. All available instrumentation 
appeared to have one or more shortcomings. Either it was not portable, 
had too few possible interaction codes, or required extensive data 
reduction labor. They felt that adequate Instrumentation must possess 
the following cnaracteri sties: (I) It must be portable. (2) It must be 
capable of use by people with relatively average academic training and 
physical coordination. (3) It must have the potential of enough codes for 
relatively complex coding systems. (4) It must provide a record of ac- 
curate timing of events. (5) The data must be reducible almost automati- 
cally to the computer. After consultation with a number of persons on 
the state of the art of electrical engineering and computer technology, 
Messrs. Sykes and Whitney invented the Minnesota Data Coding Reduction 
System. Upon consultation with the Graduate School of the University of 
Minnesota it agreed to provide the funds for reducing the invention to 
practice, find bids were sought from several firms. The bid of Electro/ 
General Corporation of Hopkins, Minnesota was accepted and construction 
began. The first encoders were delivered in late December 1967. The 
translator was delivered about March I, 1968. 

The development of MIDCARS has gone through two technical stages. 

In the first stage tones were used in a "parallel entry" data recording 
system In which the frequencies representing the selected codes were 
recorded on the analogue tape. This required a tape recorder sensitive 
to different frequencies and exact in terms of the speed and pressure of 
the tape passing the recording heads. Because of the inadequacy of com- 
mercial tape recorders in the lower price range in meeting these condi- 
tions, the original system was modified for serial entry, thus overcoming 
the deficiencies of the recorders. The pilot system we are now using 
utilizes the principle of frequency shift keying (FSK) . The modification 
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to FSK was completed in the middle of the summer of 1968. This second system 
has been tested, and has proved very dependable. To date about 194 hours of 
field observations using the tone code system, and over 100 hours of obser- 
vations using the FSK system have been completed. In both cases the coding 
categories number about twenty-five with a few additional "bookkeeping 
codes." The MIDCARS system has a potential of thirty-one different codes, 
with a good many more possible if permutations of the original thirty-one 
are added. The number of codes possible is limited more by the capacity of 
the observer than by the instrumentation Itself. 

THE INSTRUMENTATION 

For encoding the observer carries, hung around his neck, an ordinary 
commercial Norelco portable cassette tape recorder in a leatherette case. 

In the same case is an encoder which produces electronic signals. The 
portable tape recorder Is modified not only so as to receive signals, but 
also so that the permanent batteries In the recorder can be recharged 
through a battery charger which plugs Into the wall and which is built 
into the bottom of the recorder case. The whole device weighs about 
four-and-one-ha I f pounds. 

Plugged into the encoder is a hand unit at the end of a thirty- inch 
cable. In the hand unit are five switches (buttons) which correspond with 
the five digits of the left hand. These five buttons may be simultaneously 
pushed in any one of thirty-one different combinations. Each combination 
signifies a certain code. The unique signal produced by any particular 
combination of buttons is recorded on the tape cassette in tne portable 
tape recorder (this tape is hereafter referred to as the analogue tape). 
Simultaneously real time information is also recorded utilizing a clock 
pulse generator located In the encoder. 

When the tape recording of signals made during the observation is 
returned to the office the tape is played through the translator. The 
decoder not only includes the decoding electronics, but also a set of 
thumb wheels for entering data by hand, and an incremental digital tape 
recorder which produces a tape compatible with the University of Minne- 
sota's CDC 6600 computer. To save time in playthrough the tape speed is 
twice that of the original recording so that, for instance, an observation 
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of one hour is translated in thirty minutes. As each FSK code signal 
passes through the decoding electronics it is transformed into a binary 
equivalent on the computer tape, and after each such signal and a second 
binary number from the clock signal registers on the computer tape which 
corresponds with the real time In seconds from the time the observation 
began to the time when that particular signal occurred. Thus a record Is 
made on the computer tape which permits computation not only of the fre- 
quency of signals, but the duration of particular events. It will be 
noted that the real time in the analogue tape is transformed into a record 
of time. Before each analogue tape is played through the translator the 
six thumb wheels are utilized to enter on the computer tape by hand Infor- 
mation Identifying the particular analogue tape (observation). The trans- 
lator Is simple to operate and an operator can be trained in a few minutes. 
After a series of analogue tapes have been translated onto the computer 
tape, the computer tape (transient tape) is taken off the translator and 
sent to the computer center. 

When the tape Is received at the computer center the information 
thereon goes through several processes. First it is processed so that 
the information Is transferred to one or more master tapes for that 
particular study kept at the computer center. Then the transient tape 
is stored and ail future computation of data is performed on the master 
tape. The transient tape can be reused on the MiDCARS translator. At 
the time the information is transferred from the transient to the master 
tape a printoff is made which lists the file numbers, and identifying 
codes of al! data previously put on the master tape, and then provides a 
straight printoff of the data on the latest transient tape. At a later 
stage data on the master tape are processed onto an intermediate tape on 
which the data are placed in different form from the master tape itself 
for ease and economy in later manipulation of data by the computer. 

Probably the most time consuming step in the process of data reduction 
Is programming. MIDCARS requires a computer with a large memory and great 
speed. The 6600 is currently the largest and fastest computer in the world. 
Even so it takes ten or fifteen minutes of printer time to print off the 
thousand or so pages of data from the three hundred or more hours of literal 
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observations themselves. So far tnere are operational three basic programs, 
and there will soon be more. These three programs provide: (DA literal 
printoff of each observation; (2) edited printoffs classifying behavioral 
segments and sequences, placing each in a logical category, and numbering 
every sequence and segment, and classifying all logically Impossible seg- 
ments according to type; (3) counts of the frequencies of all legitimate 
categories or combinations of categories. A fourth basic program Involving 
computation of duration is in preparation. This will provide numbers which 
describe the frequency of a particular category per a standard unit of time. 
Thus observations totaling different numbers of seconds may be compared. 
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